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ABSTRACT 

The purpose cf the present study is to explore 
cost-effectiveness factors that affect the choice among alternative 
system designs for retrospective searching services. A 
cost-effectiveness model that may be used to evaluate potential 
systems was derived, and a statement of the general magnitude of 
costs that the American Psychological Association (APA) can expect in 
implementing and operating alternate systems is given. These 
“typical** costs may be used to establish the cost-etfectiveness of 
general classes of systems, such as mechanized search on-line by 
titles or by batch processing on index terms. (Author) 
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Preface 



During the period from June 1968 to April 1970» the APA‘s Office of 
Communication Management and Development, working under the direction 
of the ad hoc Communications Committee, prepared a plan for the develop- 
ment of a National Information System for Psychology. During the course 
of developing that plan, It became evident that a variety of decisions 
would have to be made with respect to the development of a retrospective 
search capability for the system. How could such a system be configured? 

Of the number of potential users, how many would actually use it? What 

woOld the system cost, and what would be the costs per search for each use? 

In an attempt to obtain a model whereby questions of this type could 
be answered, Donald W. King, Executive Vice President of Westat Research, 
Inc., Rockville, Maryland, was selected to conduct a study of the cost- 

effectiveness of retrospective search systems. King Is well known In 

the information science field for his work In evaluation and economics 
of information handling. This report, prepared by King and Nancy W. 
Caldwell under contract to APA, does not necessarily reflect the 
opinions or interpretations of the Association. 




Harold P. Van Cott, Director 
Office of Communication 
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Hi ghl i ghts of F I nd 1 ngs 

The purpose of the present study was to explore cost-effectiveness 
factors that affect the choice among alternative system designs for 
retrospective searching services. A cost-effectiveness model that may 
be used to evaluate potential systems was derived, and a statement of the 
general magnitude of costs that the American Psychological Association (APA) 
can expect in implementing and operating alternate systems is given. These 
"typical" costs may be used to establish the cost-effectiveness of general 
classes of systems, such as mechanized search on-line by titles or by batch 
processing on index terms. 

As part of this study, a thorough literature search was conducted. 

To complement the sketchy information obtained from the search, a 
number of persons who manage operating information systems were con- 
tacted. Although much of their information was proprietary, many of 
them were able to provide information that Is more realistic than that 
found in the literature, and estimates of "typical" costs are based 
heavily on these discussions. It should be emphasized that while 
these cost estimates are reasonably adequate for broad system com- 
parisons, APA must consider their own operation and each of the alter- 
nate subsystems in greater detail, using the cost-effectiveness model 
as a guideline. 

One of the chief problems encountered in both the literature sur- 
vey and the personal discussions was that cost Information was almost 
always presented in a gross manner and could not be applied to other 
systems.* In order to adapt cost information from one system environment to 
another, we must be able to isolate fixed costs from costs that vary by 
size of file, number of searches, number of terms, and average number of 
items retrieved. Furthermore, we must be able to distinguish the dif- 
ferences in cost of alternative systems and subsystems (e.g., user/ 
system interface, input, hardware, search modes, output screening modes, 
etc.). The cost-effectiveness model was derived to accommodate all of 
these factors. To emphasize the relative importance of these factors an.’ 
to consider the system in its entirety, "typical" costs of 36 system 
and subsystem alternatives are estimated. 

Finally, If APA decides to charge for retrospective search services, 
it is necessary to have some knowledge of the economic and marketing 
implications. Demand for the services can be influenced by price, ad- 
vertising, promotion, and the quality of the system. Although it is 
difficult to estimate reliably demand and a price/demand relationship, 
the model mentioned earlier, plus the examples given, yields an estimate 
of the cost/demand relationship. Some Inferences a.e also drawn con- 
cerning frequency of use of the system. 
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COST-EFFECTIVENESS OF RETROSPECTIVE SEARCH SYSTEMS 



One of the difficulties in deriving a cost mode I for the design of 
retrospective search systems is that each system consists of several sub- 
systems that can accomplish different functions by a number of alternative 
processes. The most important of these subsystems are user/system inter- 
face, input, search mode, output screening, and form of presentation 
to the user. The numerous possible alternative processes are determined 
by the hardware, software, and general procedures used to accomplish 
specific functions. System designers must choose among the alternatives 
with regard to the cost and/or effectiveness of each, but this Is sometimes 
difficult because the systems are so Interrelated, In the present study, a 
mathematical mode? that yields measures of cost-effectiveness for several 
combinations of system alternatives has been applied,^ 

The effectiveness of search system performance can be measured In 
part .by search accuracy. Perfect search accuracy Implies that searches 
yield all relevant documents and no nonrelevant materials. All major 
retrospective search systems evaluated to date have operated with far from 
perfect accuracy. In order to apply the model mentioned earlier, we measure 
accuracy by recall and fallout. Recall Is the proportion of relevant 
documents retrieved, and fallout is the proportion of nonrelevant documents 
re t r i eved, 

A large fallout implies high costs, since each retrieved document 
adds to processing, output, screening, and mailing costs. High recall also 
involves substantial costs, as shown in the relationship in Figure 1 , In 
most systems, It costs substantially more to increase recall an incremental 
amount at high levels of recall than at low levels of recall. This fact 
is borne out In the next section. 

Since all subsystems contribute to the cost-effectiveness relationship, 
all of them should be included when considering the cost-effectiveness of 
retrospective search systems. Several common alternatives are discussed. 

Most systems use an intermediary to interpret a user's search request 
and to conduct the search. There are several ways in which the inter- 
mediary can communicate with the user to form a user/system interface. 

Two common ways are by written correspondence or personal contact, as by 
telephone. A- study of the MEDLARS system (see Lancaster, 1968), which used 
written request forms. Indicated that a number of relevant documents were 
missed and nonrelevant documents retrieved due to an intermediary's not 
fully understanding the user's search requirements. The proportions of 



Briefly, the model Is a finite Markoff chain that treats recall and 
fallout ratios observed for each subsystem as transition probabilities. 
The model is described in King and Bryant (June, 1970; October, 1970) , 
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FIGURE 1. Cost versus recall for typical .systems. 
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missed relevant and retrieved nonrelevant documents observed in this 
evaluation have been applied in the analysis given subsequently. As a 
second alternative, it was assumed that personal contact could be made 
with users, increasing costs but reducing failures by one-half. (One- 
half is conjectured, since no actual value for this number could be found 
i n the 1 i tera ture . ) 

Most large system retrospective searching is performed by computer 
batch processing or on-line, and input is by Indexing from a controlled 
vocabulary or from full text of an abstract. Thus, there are essentially 
three search systems in the analysis; Index input searched by batch process- 
ing, index input searched by on-line terminal from a controlled vocabulary, 
and full-text abstract Input searched by on-line terminal from free- 
language search queries. Any level of accuracy (recall) can be achieved by 
the three systems, but with a different number of documents retrieved and, 
hence, different cost. In order to analyze each system, the present |- • 
vestigators established typical retrieval necessary to obtain recall levels 
of 40%, 60%, 80%, and 100% (see Sal ton, I 969 ). These values have been 
Incorporated with the analytical models for Illustrative purposes. 

Many systems with a large number of documents yield a correspondingly 
large number of documents retrieved so that Intermediaries must be used 
to screen out nonrelevant material. The screening Is usually performed 
on titles or titles and abstracts together. However, even though nonrelevant 
retrieval Is reduced, many relevant documents are also likely to be screened 
out by mistake. The results of two experiments have been used to estimate 
recall and fallout. Results from the first experiment. Involving tight 
screening. Indicate that a high proportion of nonrelevant material Is 
screened out, but many rele'^ant documents are also screened out. Evidence 
from the second experiment, involving loose screening, suggests poorer 
screening with correspondingly fewer relevant documents missed. 

Another system alternative Is to send Identified documents to the users 
in the form of titles or of titles and abstracts. Cost versus user con- 
venience is the principal Implication here. 

In order to show the cost Implications of potential systems, the 
analytical model was applied to all combinations (36) of two user/system 
Interfaces, three search modes at four levels of recall, and six screening 
alternatives. The analysis assumed a total file .‘ze of 100,000 docum^?nts 
(i.e., 25,000 annual input for 4 years) and 50 total relevant documents In 
the file. The results of this analysis are given In Table 1 for total 
retrieval per search and number of relevant documents retrieved per search. 

It is clear that the number of retrieved Items that is necessary to Increase 
levels of recall becomes extremely large as recall approaches 100% (note 
unscreened retrieval). For example, total retrieval from batch processing 
(with written request) doubles from 40^ to 60% recall (32 to 64), doubles 
again from 60% to 80% recall (64 to 126), and triples (126 to 376) when 
recall Is increased from 80% to 100%. Thus, one must retrieve over 10 
times more documents (32 to 376) in order to increase recall from 40% to 
100%. This, of course, has significant cost Implications, which are dis- 
cussed in the next section. 
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TABLE 1 



Total Retrieval and 
Alternative System Designs 



Number of I terns Retrieved by 

and Levels of Recall from Searching 



Reca 1 1 


Wr i tten reques t 


Telephone request 


1 eve 1 


Batch 


On- 1 i ne 


On- 1 1 ne 


Batch 


On- 1 1 ne 


On- 1 i ne 




process i ng 


i ndex 


abstract 


process 1 ng 


i ndex 


abstract 



No screening 



.40 














Retrieved 


32 


27 


25 


32 


27 


26 


Re } evant 


19 


19 


19 


20 


20 


20 


.60 














Retr i eved 


64 


51 


42 


65 


52 


43 


Re 1 evant 


29 


29 


29 


29 


29 


29 


.80 














Ret r i eved 


126 


101 


80 


127 


102 


81 


Re ! evant 


38 


38 


38 


39 


39 


39 


1 .00 














Retr i eved 


376 


213 


175 


378 


215 


177 


Relevant 


48 


48 


48 


49 


49 


49 



Tight screen on titles 



.40 














Ret ri eved 


3 


3 


3 


3 


3 


3 


Relevant 


3 


3 


3 


3 


3 


3 


.60 














Ret ri eved 


5 


5 


5 


5 


5 


5 


Re 1 evant 


5 


5 


5 


5 


5 


5 


.80 














Ret r i eved 


7 


7 


7 


7 


7 


7 


Relevant 


6 


6 


6 


7 


7 


7 


1 .00 














Retr i eved 


10 


9 


9 


9 


9 


9 


Relevant 


8 


8 


8 


8 


8 


8 



Tight screen on abstracts 



.40 














Retr i eved 


10 


10 


10 


1 1 


1 1 


1 1 


Relevant 


10 


10 


10 


1 1 


1 1 


1 1 


.60 














Retr i eved 


16 


16 


15 


16 


16 


16 


Relevant 


15 


•15 


15 


16 


16 


16 
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TABLE 1 (cont‘d.) 



Reca 1 i 


Written request 


Telephone request 


1 eve ] 


Batch 

process I ng 


On- 1 i ne 
1 ndex 


On-1 i ne 
abstract 


Batch 

p ro ce s s i n g 


On-1 1 ne 
( ndex 


On-1 i ne 
abstract 


.80 

Ret ri eved 


21 


21 


21 


22 


21 


21 


Relevant 


21 


21 


21 


21 


21 


21 


i .00 

Ret ri eved 


28 


27 


26 


28 


27 


27 


Relevant 


26 


26 


26 


26 


26 


26 



Loose screen on titles 



.40 

Ret r t eved 


25 


21 


20 


24 


21 


21 


Rel evant 
.60 


17 


17 


17 


17 


17 


17 


Retri eved 


45 


38 


32 


45 


38 


33 


Rel evant 
.80 


25 


25 


25 


26 


26 


26 


Ret ri eved 


82 


68 


56 


83 


69 


57 


Relevant 

1.00 


33 


33 


33 


34 


34 


34 


Ret ri eved 


224 


134 


!13 


225 


135 


114 


Rel evant 


42 


42 


42 


43 


43 


43 



Loose screen on abstracts 



.40 














Ret rl eved 


22 


20 


19 


23 


21 


20 


Rel evant 


16 


16 


16 


17 


17 


17 


.60 














Retri eved 


41 


35 


31 


42 


36 


32 


Relevant 


25 


25 


25 


25 


25 


25 


.80 














Ret ri eved 


75 


63 


53 


76 


63 


54 


Rel evant 


33 


33 


33 


34 


34 


34 


1 .00 














Ret r I eved 


198 


120 


102 


199 


12? 


104 


Relevant 


41 


41 


41 


42 


42 


42 
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We note that at 100% search recall, the total number of relevant 
items retrieved using written requests is ^8 -- two relevant documents 
are lost. When personal contact is made, the total number of relevant 
items retrieved Is 49 -- only one relevant document is missed. One 
might say that we should screen out the 328 nonrelevant documents (37^ 
minus 48). However, we find that the best (and most expensive) screen- 
ing process (screening on abstracts) screens out 22 of the relevant 
documents (48 minus 26) while culling out all but two of the nonrele- 
vant documents (28 minus 26). 

The on-line abstracts, on-line index, and batch-processing systems 
are ranked, in that order, with regard to total retrieval necessary to 
achieve equivalent recall levels. This relationship becomes more pro- 
nounced as the level of recall increases. For instance, with a written 
request and no screening, the total retrieval at 40% recall is 25, 27, 
and 32 documents, respectively. However, at 100%, recall, total retrieval 
is 175, 213, and 378 documents, respectively. Before one can really de- 
cide among the 36 system combinations, costs should be carefully consid- 
ered, which is the topic of the next two sections. 

Cost Model 



After many different retrospective search systems were carefully 
examined, a generalized cost model was developed, which will permit the 
APA to evaluate future, as well as present, systems. 

The total cost of any given retrospective search system is composed 
of three types of costs: 

1. fixed costs associated with each subsystem, 

2. variable costs dependent on the number of items input to the 
system, and 

3. variable costs dependent on the number of searches conducted. 
Simply stated, 

C = C + C"X, + C‘^'X2. 

Taking these three separately, APA can analyze component costs of any 
system or subsystem with regard to size of the file (e.g., APA primary 
journals versus world’s psychological literature), range of demand or 
system usage, and size of term list. 

Fixed costs . There are fixed costs associated with each subsystem. 
These include such items as staff, space rental, computer rental, and 
fixed computer storage charges (C|). Once a commitment Is made for a 
specific computerized search system, these costs will be incurred, even 
if the system Is not used at all. 
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Another fixed cost element is the rent^ staff, and screening devices 
(C2) that may used to display the full text of an abstract or document 
representat I r screening search output. Fixed costs associated with 

input (C3) ir; e such items as thesaurus development, staff, tape con- 
version, and update costs. Other fixed costs are staff, rent, and sundry 
items associated with user/system interface (C4) and mailing search out- 
put to the users (C5), The fixed cost element is then 

C' C] + C2 + + Ci^ + C^. 

Variable costs . The variable costs that are dependent on file size 
or number of items input to the system (X]) are composed of a cost per 
item of indexing, abstracting, keyboarding, and any other input processing. 
These costs can be allocated among various services that also use the in- 
put products (C5) , that is. Psychological Abstracts, current awareness an- 
nouncement, retrospective search, recurring bibliographies, and so forth. 
File loading costs (Cy) include costs that vary with number of terms (X^). 
The entire cost component can be expressed as 

C" = C6 + X5C7. 

Another type of variable cost is the cost dependent on the number of 
searches conducted per year (X2), or the demand for the retrospective 
search system. This is the most complicated of the elements of the model, 
being composed of three parts; fixed costs per search, costs dependent on 
the number of items retrieved (X^), and costs dependent on the number of 
items sent to the user (X 4 ) • The fixed elements of the cost are the set- 
up costs for mailing titles to users (Cg) and the cost of the user/system 
interface, that is, the in^ermediary (Cg) . For our purposes, two alterna- 
tive methods of user/system communication are considered; written requests 
and oral requests. 

There are three costs dependent on the number of items retrieved in 
any search (Xj): the computer costs of retrieving (C^q) and printing out 

the item (Cii; and the costs of screening each item retrieved (C) 2 )* The 
cost dependent on the number of items mailed per search (X^^) is the cost 
of actually mailing the titles or abstracts to the user (C]3). The entire 
component can be expressed as 

C'"= Cg + Cg + X3(C,o + c,, + C,2) + X^C,3- 
combining the elements of the cost model, we have 

C = C^ + C2 + C^ + + C3 

+ X*| (Cg + X^Cy) + X2[Cg + Cg + + 0^2) 

where : 

X.| = number of items input, 

X2 = number of searches conducted. 



12 
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= number of items retrieved per search, 

X4 = number of items mailed per search, 

= number of terms in authority list, 

C| = fixed cost associated with computing, 

C2 = fixed cost associated with screening, 

C3 = fixed cost associated with input, 

C4 = fixed cost associated with user/system interface, 

= fixed cost associated with mailing results, 

C5 = total input cost per item, 

Cy = total file loading cost per item per term, 

C3 = fixed cost of mailing per search, 

Cg = fixed cost of user/system Interface per search, 

C]o = computer retrieval cost per item retrieved, 

C]] = computer printing cost per item retrieved, 

C]2 = screening cost per item retrieved, 

C|3 = mailing cost per item mailed, and 
C = total annual cost. 

This general equation can be used to estimate costs of potential APA search 
s/stems as well as to compare the cost-effectiveness trade-off of system 
a1 ternati ves . 



Costs of Alternative Systems 

Nearly all published literature on costs of information retrieval systems 
has emphasized the lack of good cost-accounting procedures and, therefore, 
reliable costing information. In all discussions with persons closely in- 
volved in many different retrieval systems, the need for accurate, complete, 
consistent, and available data on costs was acknowledged. From these inter- 
views and the literature, “reasonable*' cost estimates were derived that are 
used in the preceding cost model to estimate the general magnitude of total 
costs of various alternative retrospective search systems and subsystems. 

Examples of typical values are given In Table 2 for cost I terns 
C]3 for three general systems: (a) batch processing, index input, controlled 

vocabulary search; (b) on-line processing. Index Input, controlled vocabulary 
search; and (c) on-line processing, abstract input, f ree-language search. It 
must be emphasized that while the estimated costs presented are reasonably 
adequate to establish the general magnitude of system costs, each subsystem 
should be carefully evaluated with regard to actual cost. These costs can 
then be compared with those given in the present report to see if they are in 
line. Fach cost of a potential system can also be incorporated with the model 
to determine its effect on total costs over a range of demand and In view of 
the number of items input. 

The costs are broken down into input costs, search costs, screening costs, 
and mailing costs. The three general search systems costs are directly related 
to some input costs and most search cost. The system costs are also related to 
screening and mailing costs, since each of the three systems yields a different 
number of items retrieved (for a given recall level). The costs associated 
with the three general systems are given on the following pages. 
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Input and Search Costs for Three General Systems 
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Other costs depend on the user/system Interface (written requests versus 
telephone requests). Typical costs for these are given In Table 2B. 



TABLE 2B 

Search Costs Dependent on User/System Interface 



Search 


Written request 


Te 1 e phone request 


- staff, rent, other 
overhead 


$500^ 


$500® 


Cg - staff, equipment 


$ n . 25/search. 


$ 1 5. 00/sea rch 



^Amortized over 4 years. 



Screening can be performed on titles or abstracts, which yield sub- 
stantially different costs. Typical costs for these are given in Table 2C. 



TABLE 2C 
Screening Costs 



Screen 


Titles 


Abstracts 


C 2 - staff, rent, equipment, 
other overhead 


$ 4 , 000 ® 


$32,000® 


C 12 * staff 


$.04/item retrieved 


$. 125 /item retrieved 


^Amortized over 4 years. 



Finally, mailing costs also depend on whether titles or abstracts are 
sent to the user. Typical mailing costs are given in Table 2D. 



TABLE 2D 
Mailing Costs 



Mailing 


Titles 


Abstracts 


C 5 - staff, rent, equipment, 
other overhead 


$ 250 ^ 


$ 250 ^ 


Cg - preparation, staff 


$. 20 / sea rch 




mater 1 a 1 s 


$. 35 / search 


C|^ - postage, materials 


$. 302/ i tern sent 


$ . 10/1 tern sent 



^Amortized over 4 years. 
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An example is given to illustrate how costs are derived. Assume the 
following: 

1. System processes include batch processing, telephone request, 
tight screening on abstracts, and abstracts mailed to users; 

2. number of items input (X^) is 100,000 over a 4-year period; 

3. number of searches (X2) is 4,000 per year; 

4. number of items retrieved per search (X^) is 126 (i.e., the 

recall level is 80% prior to screening — see Table 1); 

5. number of Items mailed per search (X4) is 22 (i.e., the recall 

level at 80% and after screening -- see Table 1); and 

6. number of terms in authority list {X5) is 1,000. 

The model is: . 



C - O’! + C2 + + C5 + X ^ (C^ + X^Cy) 

+ X^CCg + Cg + XgCc,^ + c,, + 

= $ 131,000 + $32,000 + $5,500 + $500 + $250 



+ 100,000r$.575 + (1,000) ($.0000375)] 

+ 4,000[0 + $15.00 + 126($.05 + $.008 + $.125) + (22)($.10)] 
= $169,250 + $61,250 + $161,032 



= $391,532 



The average cost per search is then $97*90 ($391*532/4,000); cost per 
retrieved document is $4.40 ($97*90/22); and cost per relevant item 
retrieved is $4.60 ($97*90/21). 



Using the cost model, the following costs were calculated as descftbed 
in the preceding example for demand levels of 1,000 and 4,000. It is 
emphasized again that these cost estimates are only approximations derived 
from scanty information available from a variety of sources. However, these 
estimates should be very useful for gross design comparisons, for determining 
the effect of such factors as demand on the design comparisons, and to 
serve as a benchmark to assess potential new systems. 

D i scuss 1 on 



Table 3 gives the cost per search, cost per item retrieved, and cost 
per relevant item retrived for 1,000 requests for six alternative systems. 
Table 4 gives the same information for 4,000 requests. It appears that on- 
line index is consistently the best search system with regard to all 
three cost measures.^ As the search recall level increases, the batch- 
processing system becomes nrxjre competitive. A recall level of 80% Is 
probably the most feasible. Of course, 100% recall is more desirable, but 
the incremental costs necessary to achieve the level may be too great. 



o 

One should not generalize this comparison. For example, batch process- 
ing search costs can be reduced considerably If fixed costs (C]) are allocated 
to a broader range of other service‘s or reduced by using only off-shift time. 
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TABLE 3 

Cost per Search, per Item Ret r i eved, and per Relevant I tern Retrieved 
for Alternative Retrospective Search Systems, Subsystems, 
and Recal 1 Levels (Demand = 1 ,000) 



Recal 1 1 eve 1 
and cost ($) 
for each 


Wr i t ten request 


Telephone request 


Batch 

process i ng 


On- 1 i ne 
i ndex 


On- 1 i ne 
abstract 


Batch 

process i ng 


On- 1 i ne 
i ndex 


On-line 

abstract 




No 


screen i ng 


— mail titles to users 




.40 














Search 


212.00 


117^00 


252.00 


216.00 


121.00 


256.00 


I tem 














re tr i eved 


6 . 60 


4.30 


1 . 10 


6.70 


4.50 


9.80 


Relevant item 














re tr i eved 


n.2o 


6.20 


13.30 


10.80 


6.00 


12.80 


.60 














Search 


2t3.O0 


1 17.00 


252. 00 


217.00 


121.00 


256. 00 


1 tem 














retr i eved 


3.30 


2.30 


6.00 


3.30 


2.30 


6.00 


Relevant item 














re tr i eved 


7.40 


4.00 


8.70 


7.50 


4.20 


8.80 


.80 














Search 


216. 00 


135.00 


252.00 


220.00 


138.00 


256.00 


1 tem 














re tr ie ved 


1.70 


1.30 


3.20 


1.70 


1.40 


3.20 


Relevant item 














re tr i eved 


5.70 


3.50 


6.60 


5.60 


3.50 


6.60 


1.00 














Search 


230.00 


152.00 


279.00 


233.00 


156.00 


282.00 


1 tem 














retrieved 


.60 


.70 


1 .60 


.60 


.70 


1.60 


Relevant item 














re tr i eved 


4.80 


3.20 


5.80 


4.80 


3.20 


5.80 




No screening - 


- mail abstracts to users 




.40 














Search 


215.00 


1 19.00 


254.00 


219.00 


123.00 


258.00 


1 tem 














re tr i eved 


6. 70 


4.40 


10.20 


6.80 


4.60 


9.90 


Re levant i tem 














re tr i eved 


11.30 


6.20 


13.40 


11.50 


6.20 


12.90 


.60 














Search 


219.00 


122.00 


256.00 


223.00 


125.00 


260.00 


1 tem 














ret ri eved 


3.40 


2.40 


6. 10 


3.40 


2.40 


6.00 


Relevant item 














retrieved 


7.60 


4.20 


8.80 


7.70 


4.30 


9.00 



17 



TABLE 3 (cont'd.) 



Reca 1 1 1 eve 1 


Written request 


Telephone request 


and cost ($) 
for each 


Batch 

processing 


On-1 i ne 
i ndex 


On- 1 1 ne 
abstract 


Batch 

process i ng 


On-1 i ne 
1 ndex 


On-1 i ne 
abstract 


.80 

Search 


228.00 


144.00 


260.00 


232.00 


148.00 


264.00 


1 tem 

retrieved 


1 .80 


1 .40 


3.30 


1.80 


1.50 


3.30 


Relevant item 
retrl eved 


6.00 


3.80 


6.80 


6.00 


3.80 


6.80 


1.00 

Search 


266.00 


173.00 


296.00 


237,00 


177.00 


299.00 


1 tem 

retrieved 


.70 


.80 


1.70 


.60 


.80 


1.70 


Relevant Item 
ret ri eved 


5.60 


3.60 


6.20 


4.80 


3.60 


6.10 


Tight screen 


on titles 


— mail titles to users 




.40 

Search 


218.00 


123.00 


259.00 


221.00 


127.00 


262.00 


1 tem 

retrieved 


72.67 


41.00 


86.33 


73.67 


42.33 


87.33 


Relevant item 
retri eved 


72.67 


41.00 


86.33 


, 73.67 


42,33 


87.33 


.60 

Search 


220.00 


126.00 


261 .00 


224.00 


130.00 


'264.00 


1 tem 

retrieved 


44.00 


25.20 


52.20 


44.80 


26.00 


52.80 


Relevant item 
retrl eved 


44.00 


25.20 


. 52.20 


44.80 


26.00 


52.80 


.80 

Search 


226.00 


149.00 


265.00 


230.00 


I 53 . 00 


269.00 


1 tem 

retrieved 


32.29 


21.29 


37.86 


32.86 


21 .86 


38.43 


Relevant item 
retrieved 


37.67 


24.83 


44.17 


32.86 


21 .86 


38.43 


1.00 

Search 


251 .00 


179.00 


314.00 


255.00 


183 .00 


318.00 


1 tem 

retrieved 


25.10 


19.89 


34.89 


28.33 


20.33 


35.33 


Relevant Item 
retrieved 


31 .38 


22.38 


39.25 


31.88 


22.88 


39.75 



o 
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TABLE 3 (cont'd.) 



Reca 1 1 1 eve 1 


Written request 


Telephone request 


and cost ($) 
for each 


Batch 


On-line 


On- 1 i ne 


Batch 


On- 1 i ne 


0 n- 1 i ne 


process i ng 


1 ndex 


abs t ract 


process 1 ng 


1 ndex 


abstract 



Tight screen on abstracts -- mail abstracts to users 



.40 

Search 
1 tern 


249.00 


154.00 


289.00 


253.00 


158.00 


293.00 


retrieved 
Relevant item 


24.90 


15.40 


29.00 


23.00 


14.40 


26.70 


retrieved 


24.90 


15.40 


29.00 


23.00 


14.40 


26.70 


.60 

Search 
1 tern 


254.00 


159.00 


293 . 00 


258.00 


164.00 


297.00 


retr ieved 
Relevant item 


15.90 


10.00 


19.50 


16.10 


10.20 


18.60 


retr ieved 
.80 


17.00 


10.60 


19.50 


16.10 


10.20 


18.60 


Search 


266.00 


188.00 


302.00 


270.00 


191.00 


306.00 


1 tem 

retrieved 
Relevant item 


12. 70 


8.90 


14.40 


12.30 


9.10 


14.60 


re t r i eved 


12.70 


8.90 


14.40 


12.80 


9.10 


14.60 


1.00 

Search 


312.00 


227.00 


361.00 


315.00 


231.00 


365.00 


1 tem 

ret r 1 eved 
Relevant item 


11.10 


8.40 


13.90 


11.30 


8.60 


13.50 


retrieved 


12.00 


8.70 


13.90 


12.10 


8.90 


14.00 




Loose 


screen on titles -- mail titles to users 




.40 

Search 
1 tem 


217.00 


1 23 .00 


259.00 


221 .00 


1 27.00 


262.00 


ret r i eved 
Relevant item 


8.68 


5.86 


12.95 


9.21 


6.05 


12.48 


retr i eved 
.60 


12.76 


7.24 


1 5.24 


13.00 


7.47 


15.41 


Search 


220.00 


1 26.00 


261 .00 


224.00 


130.00 


264.00 


1 tem 

retrieved 
Relevant item 


4.89 


3.16 


8.16 


4.98 


3 .42 


8.00 


retrieved 


8.80 


5.04 


10.44 


8.62 


5.00 


, 10.15 



o 
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table 3 (cont'd.') 



Reca I 1 leve ? 


Written request 


Telephone reques t 


and cost ($) 
for each 


Batch 

process i ng 


On - 1 1 ne 
1 ndex 


On- 1 i ne 
abst ract 


Batch 

process! ng 


On- I \ ne 
i ndex 


On- 1 \ ne 
abstract 


.80 

Search 


226.00 


149.00 


265.00 


230.00 


153.00 


269.00 


1 tern 

re t rl eved 


2.77 


2.1 9 


4.73 


2.77 


2.22 


4.71 


Relevant item 
retrieved 


6.85 


4.52 


8.03 


' 6.76 


4.50 


7.91 


1.00 

Search 


251 .00 


1 80.00 


314.00 


255.00 


1 83 . 00 


31 8.00 


1 tern 

re t r i eved 


1 .12 


1 .34 


2.78 


1 .13 


1.36 


2.78 


Relevant item 
retrieved 


5.98 


4.29 


7. '+7 


5.93 


4.26 


7.40 



Loose screen on abstracts — mail abstracts to users 



.40 

Search 


250.00 


155.00 


290.00 


254.00 


159.00 


294,00 


1 tern 

retrieved 


11.40 


7.80 


15.30 


11.00 


7.60 


14.70 


Relevant item 
retrieved 


15.20 


9.50 


17.70 


15.10 


9.50 


17.50 


.60 

Search 


257.00 


162.00 


295.00 


261.00 


166.00 


299.00 


1 tern 

retrieved 


6.30 


4.60 


9.50 


1 6.20 


4.60 


9.30 


Relevant item 
ret rieved 


10.40 


6.60 


12.00 


10.30 


6.60 


11.80 


.80 

Search 


271.00 


192.00 


305.00 


275.00 


196.00 


309.00 


I tern 

retrieved 


3.60 


3.10 


5.80 


3.60 


3.10 


5.70 


Relevant item 
retrieved 


8.30 


5.90 


9.30 


8.00 


5.80 


9.20 


1 .00 
Search 


329.00 


237.00 


368.00 


332.00 


240.00 


372.00 


1 tern 

retrieved 


1.70 


2.00 


3.60 


. 1 .70 


2.00 


3.60 


Relevant 

retrieved 


8.00 


5.80 


9.00 


7.90 

1 


5.70 


8.90 



ERIC 
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TABLE 4 

Cost per Search, per Item Retrieved, and per Relevant I tern Retrieved 
for A1 ternative Retrospective Search Systems, Subsystems, 
and Recall Levels (0emand=4, OOO) 



Reca 1 1 leve 1 


Written request 


Telephone reques t 


and cost ($) 
for each 


Batch 

process 1 ng 


On- 1 i ne 
i ndex 


On-line 

abstract 


Batch 

process 1 ng 


On- 1 1 ne 
i ndex 


On- 1 i ne 
abstract 



No screening — mall titles to users 



.40 

Search 


63.00 


42.00 


78.00 


67.00 


46.00 


82.00 


1 tern 

retrieved 


2.00 


1.60 


3.10 


2.00 


1.70 


3.20 


Relevant item 
retrieved 
.60 

Search 


3.30 


2.20 


4. 10 


3.30 


2.30 


4.10 


64.00 


47.00 


78.00 


68.00 


50.00 


82.00 


1 tern 

retrieved 


1.00 


.90 


1.90 


1 .10 


1.00 


1 .90 


Relevant Item 
retrieved 


2.30 


1.70 


2.70 


2.40 


1.70 


2.80 


.80 

Sea rch 


68.00 


55.00 


92.00 


71.00 


59.00 


95.00 


1 tern 

retri eved 


.50 


.50 


1.20 


.60 


.60 


1 .20 


Relevant Item 
retrieved 


1 .80 


1.50 


2.40 


1 .80 


1.50 


2.50 


1 . 00 
Search 


81.00 


78.00 


118.00 


84.00 


82.00 


122.00 


1 tern 

retrieved 


.20 


.40 


.70 


.20 


.40 


.70 


Relevant Item 
retrieved 


1.70 


1.60 


2.50 


1.70 


1.70 


2.50 



No screening — mail abstracts to users 



.40 

Search 


66.00 


45.00 


81.00 


70.00 


48.00 


85.00 


1 tern 

retrieved 


2.00 


1.70 


3.20 


2.20 


1.80 


3.30 


Re levant i tern 
retrieved 


3.50 


2.40 


4.30 


3.50 


2.40 


4.20 


.60 

Search 


71.00 


51.00 


83.00 


74.00 


55.00 


86.00 


1 tern 

retrieved 


1.10 


1 .00 


2.00 


1.10 


1.10 


2.00 


Relevant Item 
retrieved 


2.50 


1.80 


2.90 


2.60 


1 .90 


3.00 



o 

ERIC 
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TABLE A (cont'd.) 



Recal 1 level 


Written request 


Telephone request 


and cost ($) 
for each 


Batch 

process \ nq 


On-1 i ne 
i ndex 


On-1 i ne 
abst ract 


Batch 

process i nq 


On-1 i ne 
i ndex 


On-1 i ne 
abstract 


.80 

Search 


80.00 


65.00 


99.00 


84.00 


69.00 


103.00 


1 tern 

ret rleved 


.60 


.60 


1.20 


.70 


.70 


1.30 


Relevant item 
retrieved 


2.10 


1.70 


2.60 


2.10 


1.80 


2,70 


1.00 
Sea rch 


117.00 


99.00 


136.00 


121.00 


103.00 


139.00 


( tern 

ret r i eved 


.30 


.50 


.80 


.30 


.50 


.80 


Relevant item 
ret r! eved 


2.40 


2.10 


2.80 


2.50 


2,10 


2.90 



Tight screen on titles — maii titles to users 



.40 

Search 


65.00 


46.00 


82.00 


69.00 


50.00 


86.00 


1 tern 

ret ri eved 


21 .67 


15.33 


27.33 


23.00 


16.67 


28.67 


Relevant item 
retrieved 


21 .67 


15.33 


27.33 


23.00 


16.67 


28.67 


.60 

Search 


68.00 


53.00 


84.00 


72.00 


57.00 


88.00 


1 tern 

retrieved 


13.60 


10.60 


16.80 


14.40 


11.40 


17.60 


Relevant item 
ret rieved 


13.60 


10.60 


16.80 


14.40 


11 .40 


17.60 


.80 

Search 


74.00 


67.00 


101 .00 


78.00 


71 .00 


1 05.00 


1 tern 

retrieved 


10.57 


9.57 


14.43 


11 .14 


10.14 


15.00 


Relevant item 
ret ri eved 


12.33 


11.17 


16.83 


1 1 .14 


10.14 


15.00 


1.00 

Search 


99 .00 


102.00 


151 .00 


103.00 


106.00 


155.00 


1 tern 

ret rieved 


9.90 


11.33 


16.78 


1 1 .V> 


11 .78 


17.22 


Relevant item 
retrieved 


12.38 


12.75 


18.88 


12.88 


13.25 


19.38 



o 




ri r 
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table 4 (cont'd. ) 



Recall level 
and cost ($) 
for each 


Wr i tten reques t 


Telephone request 


Batch 


On- 1 i ne 


On- 1 i ne 


Batch 


On- 1 i ne 


On- 1 i ne 




process i ng 


i ndex 


abst ract 


process i ng 


i ndex 


abstract 



Tight screen on abstracts -- mail abstracts to users 



.40 












96.00 


Search 


76.00 


56.00 


92.00 


80.00 


60.00 


1 tem 

ret ri eved 
Relevant item 


7.60 


5.60 


9.20 


7.20 


5.40 


8.70 


8.70 


ret ri eved 


7.60 


5.60 


9.20 


7.20 


5.40 


.60 

Search 


82.00 


65.00 


95.00 


86.00 


85.00 


99.00 


1 tem 

retrieved 
Relevant item 


5.10 


4. 10 


6.40 


5.30 


5.30 


6.20 


ret rieved 


5.50 


4.40 


6.40 


5.30 


5.30 


6.20 


.80 

Search 


93.00 


85.00 


117.00 


98.00 


89.00 


121.00 


Item 

ret ri eved 
Relevant item 


4.40 


4.00 


5.60 


4.40 


4.20 


5.80 


5.80 


retrieved 


4.40 


4.00 


5.60 


4.70 


4.20 


1.00 

Search 


138.00 


129.00 


162.00 


142.00 


133.00 


166.00 


1 tem 

»-et:r i eved 
Relevant item 


5.00 


4.80 


6.20 


5.10 


4.90 


6.20 

6.40 


retrieved 


5.00 


5.00 


6.20 


5.50 


5.10 




Loose screen on titles — mail 


titles to 1 


users 




.40 

Search 


65.00 


46.00 


82.00 


69.00 


50.00 


86.00 


! tem 

retrieved 
Relevant item 


2.60 


2.19 


4.10 


2.88 


2.38 


4.09 

5.06 


2.94 


retrieved 

.60 

Search 


3 .82 


2.71 


4.82 


4.06 


68.00 


53.00 


84.00 


72.00 


57.00 


88.00 


1 tem 

retrieved 
Relevant item 


1 .51 


1 .39 


2.63 

3.36 


1 .60 


1 .50 


2.67 




3.38 


retrieved 


2.72 


2.12 


2.77 


2.1 9 



I o 
lERJC 
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TABLE 4 (cont'd.) 



Reca 1 1 1 eve 1 


Written request 


Telephone request 


and cost ($) 
for each 


Batch 

process i ng 


On-1 I ne 
i ndex 


On-1 i ne 
abstract 


Batch 

process i ng 


On-1 i ne 
i ndex 


On- 1 i ne 
abstract 


.80 

Search 


75.00 


67.00 


101.00 


78.00 


71 .00 


105.00 


1 tern 

retrieved 


.91 


.99 


1 .80 


.94 


1 .03 


! .84 


Relevant item 
retrieved 


2.27 


2.03 


3.06 


2.30 


2.09 


3.09 


1.00 

Search 


99.00 


101 .00 


151.00 


103.00 


106.00 


155.00 


1 tern 

retrieved 


.44 


.75 


1.34 


.46 


.79 


1 .36 


Relevant item 
retrieved 


2.36 


2.40 


3.60 


2.40 


2.47 


3.60 


Loose screen on abstracts — mail abstracts 


to users 




.40 

Search 


77.00 


57.00 


93.00 


81.00 


61.00 


97.00 


1 tern 

ret ri eved 


3.50 


2.80 


4.90 


3.50 


2.90 


4.80 


Relevant item 
retrieved 


4.70 


3.50 


5.70 


4.80 


3.60 


5.70 


.60 

Search 


84.00 


67.00 


97.00 


88.00 


71.00 


101.00 


1 tern 

retrieved 


2.10 


1.90 


3. 10 


2.10 


2.00 


3.20 


Relevant item 
ret rieved 


3.40 


2.70 


4.00 


3.50 


2.80 


4.00 


.80 

Search 


99.00 


89.00 


120.00 


103.00- 


93.00 


124.00 


1 tern 

retrieved 


1.30 


1.40 


2.30 


1.40 


1.50 


2.30 


Relevant item 
retrieved 


3.00 


2.70 


3.70 


3.10 


2.80 


3.70 


1.00 

Search 


155.00 


138.00 


170.00 


159.00 


142.00 


174.00 


1 tern 

retrieved 


.80 


1.20 


1.70 


.80 


1.20 


1 . 70 


Relevant item 
retrieved 


3.80 


3.40 


4. 10 


3.80 


3.40 


4. 10 



24 
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When comparing written request against telephone request, we find 
that in some instances, written requests may cost less for the search but 
more for each relevant item retrieved (e.g., see the first section of 
Table 3 at: ,80 recall). However, the differences are so small that the 
distinction may not be important. The same holds true for mailing titles 
or abstracts to users so that one may choose the latter merely to provide 
a better service to the users. 



It is noted that tight screening does not cost much more per search 
than loose screenin^^ or no screening but that it does cost much more per 
item retrieved and per relevant item retrieved. Also, the cost per search 
of tight screening on abstracts appears to be considerably greater than 
tight screening on titles, while the cost per item retrieved and per 
relevant item retrieved is- less. This is due to the fact that t i gh\ screen- 
ing greatly reduces the number of relevant as well as nonrelevant documents 
retrieved. The cost of loose screening on titles is consistently less than 
that of loose screening on abstracts. As might be expected, loose screen- 
ing on titles costJ very little more than no screening, while loose screen- 
ing on abstracts does cost some more. 

One important consideration is whether or not the cost relationships 
among different systems hold over different levels of demand. For example, 
if on-line index/written request/screen on titles/mai'i titles is better 
than on-iine abstract/written request/screen on abstracts/mail abstracts 
at i,000 requests, is it also superior at 4,000 requests? Second, if the 
former is better with regard to total search cost, cost per item retrieved, 
or cost per relevant item retrieved at 1,000 requests, is it also bette 
with regard to these measures at A, 000 requests? Even though there are 
small differences between systems at 1,000 and 4,000 requests, the differ- 
ences are not appreciable enough to be of real concern. Also, the relation- 
ships observed for total retrieval, number of items retrieved, and number 
of relevant items retrieved remain essentially the same for 1,000 and 4,000 
requests . 

To determine a range of level of demand that APA might be able to 
expect for a retrospective search system, similar systems were investigated. 
Two systems that do not charge for use of the retrospective search system 
(the Oefense Documentation Center, DDC ; and MEDLARS) report demands of 

24.000 and 1 2, 000 (respec t I ve 1 y) , National Technical Information Service 
(formerly the Clearinghouse for Scientific and Technical Information), 
with a demand of 8,000, charges a nominal amount for its search service. 

The Smithsonian's Science Information Exchange discovered that when it 
began to charge $35.00 for an unscreened search, demand dropped from 

8.000 to 4,000. 



As shown in Table 5, cost Is relatively insensitive to demand when 
demand is greater than 4,000, Table 5 also shows that the cost to APA 
of the ret rospect ive search system is such that if APA wants a self- 
supporting system, it will have to charge a price that according to the 

previously cited experience, will keep the demand within a range of 1,000 

to 4,000. In this demand range, the least Inexpensive system -- on-line 

Index with written requests, no screening, and mailing of titles -- remains 

the least expensive. 
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TABLE 5 

Costs per Search with Two Different Allocations of 
the Indexing Costs and Thesaurus Development Costs 
to the Retrospective Search System 



Number of 
searches 


Fixed cost 

Cl + 


Fixed cost 
(a 1 located) 
C3 + C(^ + C5 


Var 1 able 


costs 


Total cost 


Tota 1 
cost per 
search 


C" 


C"* 


1/3 of the indexing costs and 


1/2 of the thesaurus development costs 


500 


163,000 


6250 


61,250 


20,129 


250,629 


501.26 


1,000 


1 63 , 000 


6250 


61,250 


40,258 


270,758 


270.76 


2,000 


1 63 , 000 


6250 


61,250 


80,516 


311 ,016 


155.51 


3,000 


1 63 , 000 


6250 


61,250 


120,774 


351,274 


1 17.09 


4,000 


1 63 , 000 


6250 


61,250 


161,032 


391,532 


97.88 


5,000 


1 63 , 000 


6250 


61,250 


201,290 


431,790 


86.36 


6,000 


1 63 , 000 


6250 


61,250 


241 , 548 


472,048 


78.67 


10,000 


1 63 , 000 


6250 


61,250 


402,580 


633,080 


63.31 




All of 


the indexing . 


and thesaurus 


deve 1 opment 


costs 




500 


1 63 , 000 


9750 


121,250 


20,129 


314,129 


628.26 


1,000 


163,000 


9750 


121,250 


40,258 


334,258 


334.26 


2,000 


163,000 


9750 


121,250 


80,516 


374,516 


187.26 


3,000 


163,000 


9750 


121,250 


120,774 


414,774 


138.26 


4,000 


1 63 , 000 


9750 


121 ,250 


161,032 


■455,032 


113.76 


5.000 


1 63 , 000 


9750 


121,250 


201,290 


495,290 


99.06 


6,000 


163,000 


9750 


121,250 


241,548 


535,548 


89.26 


10,000 


163,000 


9750 


121,250 


402,580 


696,580 


69.66 
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As described in the preceding example, some of the Input costs were 
allocated to various other services. For the costs presented in Table 3 
and 4, one-third of the indexing costs and half of the thesaurus develop- 
ment costs were allocated to the retrospective search system. To in- 
vestigate the sensitivity of the costs to different allocations of these 
fixed cost elements, the cost per search for this system^ at various levels 
of demand was calculated for two different allocations of the fixed costs. 
The first allocation is that described earlier and used in Tables 3 and 4 
for comparisons with other system alternatives. In the second, all of the 
indexing and thesaurus development costs were allocated to the retrospective 
search system. As shown in Table 5, the costs per search are relatively 
insensitive to this change in allocation. 

It is clear that APA*s Information system resides in a marketlike 
environment and that all of the economic and marketing implications of 
this environment must be considered. It is also clear, however, that the 
distribution and sale of information products and services is not like 
most marketing environments in that these products and services are 
interrelated and the functions involved in article transfer may be per- 
formed in many ways. The APA will be faced with a number of decisions 
concerning marketing of new services and modification of the old. These 
decisions Include questions of pricing, promotion and advertising policies, 
and channels of distribution; and they must be based on considerations of 
cost, income, .demand, and the effect of the decisions on other components 
of the system (this discussion excerpted from King and Brown, 1970)* 

The schema in Figure 2 depicts the functions and processes of the 
APA system In a marketing environment. It is shown that processes 
necessary to accomplish the composition, reproduction, acquisition and 
storage. Identification, location, and presentation functions lead to 
improyemehts In such things as accessibility, quality, accuracy, spped, 
and timeliness of article transfer from authors to users. These improve- 
ments are made in order to Increase user satisfaction, which. In turn, 
motivates the psychologists to use the system. This motivation, however, 
is also partially determined by the price one must pay to use the system 
and by promotion, sales, and advertising procedures. The price the 
psychologist must pay involves not only APA's charges for its products 
and services but also what he must pay of his own time. For example, if a 
retrospective search results In 5,000 Identified titles, he is not likely 
to be satisfied since he must pay such a high price of his own time to 
screen out those documents that do not interest him. 

In order to make decisions concerning marketing factors, APA should 
design and implement an Internal costing system, an example of which is 
given by Helmkamp (19^8), This system must be able to identify unit costs 
that can be subdivided into fixed and variable costs. Information products 
and services typically have a high fixed cost and relatively low marginal 
cost. For example, the fixed cost for producing a journal article may be 
as illustrated In Figure 3. When one plots the marginal cost against 



^Batch processing, telephone request, tight screening on abstracts, 
and abstracts mailed to users. 
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FIGURE 2. Relationships among functions and measures when users are not a oart of the system bein^j evaluateH. 
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DEMAND 

FIGURE 3. Typical cost curve for information products and services. 




FIGURE 4. Typical marginal cost curve for information products and services. 



o 

ERIC 



29 



UNIT PRICE ($) 



- 25 “ 






-26- 



quantity or usage, the curve drops as shown in Figure 4. It is important to 
establish marginal cost over a likely range of demand for each of the products 
and services. 

The APA‘s cost-accounting system must also be able to identify direct 
and indirect cost, where the Indirect cost involves such items as adminis- 
tration and overhead. Furthermore, it is necessary to isolate indirect costs, 
such as the preparation of magnetic tapes for computer-controlled photocompo- 
sition, so that these costs can be allocated to all of the derivative products 
that will come from these tapes. 

Income is determined by the cost of producing the information products 
and services and the income derived from demand. The income derived from de- 
mand is found by multiplying demand by price per unit. However, since the 
information products and services provided by A PA yield a direct va.l ue to so" 
ciety as a whole and not just to individual users, there is Justification for 
society's partially funding these important operations through such means as 
the National Science Foundation. This kind of funding can best be accomplished 
through providing research c'nd developmental capital in order to get a system 
operational, at which point the system can be self-sustaining. It -is clear 
that a system such as the one envisioned at APA is not likely to be developed 
by a private organization since the capital outlay would extend over a long 
period and the. return on investment would probably not accrue in a sufficient 
time to make the return worthwhile. 

As indicated in Figure 2, demand is determined by the influence of the 
services themselves, promotion, and price. The relative importance of these 
factors depends largely on the characteristics of the market for the infor- 
mation products and services. There are two classes of market that* APA will 
serve: individuals and institutions. Each of these two classes has substantial- 

ly different resources available for purchasing APA^s services. For example, 
an individual subscriber may be able to spend only $50 to $100 per year, where- 
as an institution may spend anywhere from $1,000 to $20,000 per year. This 
means that the two markets may present substantially different demand curves. 

One would expect the institutional market to have a relatively inelastic (de- 
mand not highly sensitive to changes in price) demand curve, as shown in Figure 
5. On the other hand, the market consisting of individual psychologists proba- 
bly would have an elastic (highly sensitive to price changes) demand curve, as 
shown in Figure 6. 

This means that APA will have to define carefully the market for each of 
its products and services and establish a corresponding pricing policy. Fixed 
and direct cost might be allocated as a component of the price In such a way 
that a major portion is allocated to those products and services that have an 
inelastic demand and the remainder to those that have an elastic demand. 
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